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ABSTRACT 

What are the most significant factors that motivate and inhibit faculty with regard to teaching in online 
environments? And what are the specific kinds of experiences that underlie and explain the importance of 
these factors? One goal of this study was to add to understanding of these issues, but the primary purpose 
of this study is determining how well these questions can be answered using the method of structured 
focus groups. This paper describes the methods and results of a pilot study conducted using four focus 
group interviews of faculty experienced in teaching using “Asynchronous Learning Networks” (ALN) at 
one university, and a single focus group at a second university in order to explore generalizability. For the 
university at which four group interviews were conducted, the rank orders of leading motivators and 
demotivators were quite consistent. Leading motivators include the flexibility allowed by being able to 
teach “anytime/any where;” better/more personal interaction and community building supported by the 
medium; the technical and creativity challenges offered by this mode of teaching; being able to reach 
more (and more diverse) students; and better course management. Major sources of dissatisfaction are 
more work, medium limitations, lack of adequate support and policies for teaching online, and the fact 
that the medium is not a good fit for some students. Very similar results were found through the 
replication focus group conducted at a different institution. 
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I. INTRODUCTION 

Online education is increasing access to college in ways that were never before possible. With estimates 
of more than three million students enrolled in online courses and with forecasts of continued growth far 
outpacing growth in enrollments in traditional college classrooms, it is critical that we investigate this 
“booming” phenomenon. While expanding access to higher education remains a laudable goal, increasing 
access without ensuring quality is meaningless — or worse, dangerous. Historically, faculty have played a 
central role in the quality of college courses and degree programs, and faculty acceptance of online 
education will be essential if online and traditional modes of delivery are to be equivalent. Evidence 
exists, however, to suggest that faculty may not accept online teaching and learning to the extent 
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necessary to ensure this equivalence and therefore to allow continued meaningful expansion. In a recent 
national study, for example Allen and Seaman [1] report that less than one-third of chief academic 
officers believe that faculty at their institutions feel online and traditional modes are equivalent: 

Although online education continues to penetrate into all types of institutions, a relatively stable 
minority of Chief Academic Officers (28% in 2003 compared with 31% in 2005) continue to 
believe that their faculty fully accept the value and legitimacy of online education [1], 


We need more systematic evidence to understand why faculty at many institutions have firmly embraced 
online teaching while their peers at others colleges continue to question its legitimacy. What are the 
concerns, challenges and barriers professors confront in the adoption of online education? What are the 
affordances and advantages that successful online faculty report? In this paper we will address these 
issues through an examination of “motivators and demotivators” for online teaching and learning. 

This paper presents the methods and preliminary findings from focus group interviews of experienced 
online faculty conducted in two institutional settings in the northeastern United States, one a medium 
sized technological university which we will refer to as “TechU” and the other a small community 
college. The total study includes both online surveys of faculty and focus group interviews at two 
universities. Subsequently, we hope to include a wider variety of institutions of various sizes, types, and 
geographical locations more representative of higher education in the United States. 


Teaching via Asynchronous Learning Networks (ALN) integrates social and technical aspects. It depends 
upon technologies such as the Internet and the World Wide Web to link together teachers and learners and 
learning resources, but it is an effective means of learning only when collaborative social/pedagogical 
processes emerge from the communication that is supported by the technology [2]. Key to this process is 
the role of the faculty member to structure and facilitate the online interaction. 


For focus group studies reported in this paper, our research questions are: 

• Can structured focus groups produce reliable, useful information about faculty motivators at a 
reasonable expenditure of time and effort? 

• When faculty are asked to name their top sources of motivation and demotivation for teaching 
online, and to discuss them in a group of peers, does a consistent set of factors emerge from 
different focus groups at the same university? 

• What are the underlying experiences or components of these factors that explain why they are so 
important? 

• What are the implications of these findings for steps that could be taken to increase the number of 
faculty for whom online teaching is a satisfying and rewarding experience? 


II. REVIEW OF THEORETICAL FRAMEWORKS AND THE 

RESEARCH LITERATURE 

We have reached a stage in ALN in which the early adopters are, to a large extent, already involved. We 
need to know more about the factors that lead faculty to become and remain engaged and enthusiastic. 
Models of social change and adoption of innovation can help to provide a framework for acquiring this 
knowledge. A number of relevant change and adoption models exist [3, 4, 5, 6, 7, 8, 9, 10, 11] and a 
component of this research will be to identify which of these models is best suited to understanding 
adoption of online teaching to guide subsequent stages of the study. A promising direction in this regard 
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may be to look at the adoption of online teaching as a process, rather than an event, reflecting Fuller’s 
Stages of Concern Model [6], and Hall’s Concerns Based Adoption Model (CBAM) [9]. 


Another benefit of an analysis of current theoretical models is the guidance it can offer in the 
development of the study design. Roger’s Diffusion of Innovation Model [11] was applied to the design 
of the focus group questioning route. It suggests we simultaneously examine characteristics of the 
individual adopter, the institutional setting, and the technology itself — steps that have not often been 
taken in research on faculty adoption of online teaching in higher education. It follows that we expect the 
leading motivators and demotivators for faculty will differ according to the institutional setting, may be 
related to the specifics of the software platform and media used, and may also be related to individual 
characteristics, particularly the status of the faculty member in regard to tenure and promotion. Thus, for 
the focus group study presented in this paper, we designed the questioning route to begin with each 
faculty member describing their individual academic status and prior experiences with teaching online, 
including the software platform(s) used. This research will eventually compare and contrast results for 
different colleges and universities, to see to what extent the institutional context does shape the results. 
Most of the emerging empirical research on ALNs has focused on students, but the assessment of faculty 
roles and characteristics that influence their satisfaction with ALNs has received limited empirical 
attention [12]. 


Several challenges for prospective faculty were identified in a study by Muilenberg and Berge [13], which 
examined the barriers that instructors encounter when they transition from face-to-face to distance 
teaching. Responding instructors identified organizational change and administrative support structures as 
their main concerns, and also identified lack of technical expertise and social interaction difficulties as 
important problems. These findings were further supported in a more recent study by Alavi and Gallupe 
[14], who concluded that institutions often underestimate the need for faculty training and support 
structures, especially for those who are new to online instruction. 


Most studies of faculty behavior and attitudes in relation to online learning point out that substantial 
change in teaching roles must take place in order to be an effective teacher in this environment. In a series 
of influential papers, Garrison and Anderson and their colleagues [15] claim that online instructors must 
reassess their roles in terms of a series of constructs, including “social presence,” “teaching presence" and 
resultant “cognitive presence” in order to build an effective “community of inquiry.” Coppola, Hiltz and 
Rotter [16] analyzed 20 semi-structured interviews with ALN faculty at a technological university in 
terms of role changes that occur when they become virtual professors. They classify role changes enacted 
by instructors in ALN settings in terms of cognitive roles, affective roles, and managerial roles. The 
cognitive role, which relates to mental processes of learning, information storage, and thinking, shifts to 
one of deeper cognitive complexity. The affective role, which relates to influencing the relationships 
between students, the instructor, and the classroom atmosphere, requires faculty to find new tools to 
express emotion, yet most of the faculty interviewed felt that their relationships with students became 
more intimate. The managerial role, which deals with class and course management, requires greater 
attention to detail, more structure, and additional student monitoring. Overall, faculty reported a change in 
their teaching persona, towards more precision in their presentation of materials and instructions, 
combined with a shift to a more Socratic pedagogy, emphasizing multilogues with students. 


There have been a relatively small number of prior empirical studies of faculty satisfaction with teaching 
online. Almeda and Rose [17] interviewed nine instructors teaching writing courses online at one 
university and reported that instructors were generally satisfied with their experience. Concerns related to 
lack of student motivation, difficulties adjusting to asynchronous course delivery, and compensation. In 
two of the largest study to date, Fredericksen et al. [18] and Shea et al. [19] found very high levels of 
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satisfaction among SUNY Learning Network faculty who responded to an online survey. For instance, 
Shea et al. found: 

• 33% of the faculty surveyed felt that their online students performed better, and 41% felt that 
there was no difference between their online students and their classroom students. Satisfaction 
with online teaching was higher for those faculty members who assessed their online student 
performance to be relatively better. 

• 51% felt that student interaction was higher in online courses, 25% felt there was no difference, 
and 24% felt it was lower in online courses. 

• 60% cited interest in on-line teaching and learning as their motivation for teaching online courses, 
9% cited interest in technology/internet as the motivation. Results indicate that satisfaction with 
online teaching was much higher for these cited motivations, relative to others. 

• 33% strongly agreed and 64% agreed that technology had a positive effect on their teaching. 
Satisfaction with online teaching was higher, the stronger the feeling that technology had a 
positive effect. 

• Only 23% felt that technical difficulties made online teaching more difficult. For this group, the 
satisfaction with online teaching was significantly lower relative to the remaining group. 

• 58% of respondents reported more systematic design of instruction in their online courses, 37% 
reported no difference and only 6% reported less systematic design of instruction. 

• 85% felt the experience of designing and teaching an online course would improve their 
classroom teaching [19]. 


At the University of Central Florida, Flartman, Dzuiban, and Moskal [20] surveyed 39 faculty members 
teaching in totally online courses, mixed mode courses with reduced “seat time” for the face-to-face 
portion, and mixed mode with no reduced seat time. The results of the impact evaluation at UCF indicate 
that faculty feel that their workload increases with teaching online, along with the quality and amount of 
interaction with and between students. On the other hand, they are concerned that on-line teaching may 
not fit into the academy culture. The authors argue that faculty satisfaction and student outcomes are 
strongly related and that their interaction is the most important outcome. Finally, the authors conclude 
that faculty satisfaction is both a dependent and independent variable that is nested within colleges, 
departments, and program areas. 


Shea, Pickett and Li [21] performed a multivariate analysis on survey data from 913 faculty members in 
36 New York colleges. The authors found that a significant portion of variance in a composite factor 
reflecting faculty satisfaction with online teaching could be modeled based on other composite factors 
reflecting levels of interaction with students: learning that faculty had gained from online teaching, 
adequate technical support faculty had received, and the discipline in which they taught. Despite a large 
and diverse sample size and a relatively sophisticated analytical approach, a majority of the variance in 
online faculty satisfaction among this sample was unexplained. Clearly, additional research is required. 


These prior studies and some of the instrumentation served as the basis for development of an online 
questionnaire which solicited ratings by faculty of the importance to them of various sources of potential 
satisfaction or dissatisfaction with teaching online at their university, as explained further below. The 
online questionnaire was used in this study only as a means of providing “common ground” for faculty 
participating in the focus groups, prior to their discussions. Data collection via the questionnaires was not 
completed until August 2006, and the results have not yet been analyzed. 
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III. METHOD: DEVELOPMENT OF THE STRUCTURED 
FOCUS GROUP TECHNIQUE 

The major component of this study has been to develop procedures and instruments to assess faculty 
satisfaction and motivation to teach online. Two modes of inquiry have been undertaken at this stage: a 
quantitative method involving the development and administration of an online questionnaire which all 
faculty at the two participating universities were invited to answer, and a qualitative approach involving 
the development of interview protocols to be conducted with focus groups. This paper concentrates on the 
focus group technique and results. The procedures developed over a series of four sessions at TechU are 
described in detail, since we hope that other institutions may use them, and compare the results to ours. 
Only when the same instrumentation has been used in a variety of higher education settings will we know 
which motivators and demotivators seem to be universally important to current and prospective ALN 
faculty, and which vary with the organizational culture and policies. 


Guided group discussion methods such as Nominal Group Technique and Focus Groups are especially 
well suited to uncovering and documenting the “why” behind opinions, and in obtaining much more 
depth and breadth of analysis from participants than are available from individual data collection methods 
[22, 23, 24]. In Nominal Group Technique, there is a period of individual generation of ideas before 
sharing with the group at large, and also typically, a rank ordering of the importance of various “lists” that 
participants develop. In focus groups, there is an extensive group discussion of issues that can benefit 
from complementary insights. The focus group discussions were structured by first making sure that all 
participants were aware of the full known range of possible motivators and demotivators; then having 
each participant write down their “top three,” in line with Nominal Group Technique; and then discussing 
these factors systematically, often using a round-robin approach to make sure everyone had an equal 
opportunity to participate. The final step was voting, as in Nominal Group Technique. The sessions lasted 
2.5 to 3 hours each. 


The process which we developed consisted of several steps, which are described briefly below. The 
Appendix gives the complete, detailed script and procedures used in preparing faculty for the focus group 
and in conducting the sessions. 

• Group composition: Each of the groups consisted of five to seven experienced ALN faculty; some 
of whom have tried it once and not repeated. All faculty who had taught at least one online course 
during the previous three years at a mid-sized Eastern research university were contacted and 
given a list of available meeting times. Purposive sampling procedures were employed to ensure a 
balanced sample of relatively new and more experienced online instructors and to include 
instructors in a range of academic disciplines. Participants were given a lunch or light supper 
prior to the session, and a $50.00 gift card for an online bookstore. 

• Participants were asked to first take the online survey, which systematically listed every possible 
motivator and demotivator that was found in the literature, and asked them to rate the importance 
of each factor to them. The questionnaire consists of 65 items. Based on previous studies of 
faculty satisfaction with teaching online, this questionnaire is an expansion and generalization of 
instruments previously used at SUNY (e.g. [18, 19]) and extensively tested in prior research for 
the validity of constructs. The items measuring importance of potential sources of satisfaction or 
dissatisfaction were presented in labeled sets which included opportunities for professional 
growth, interest in reaching new student audiences, job security and tenure and promotion factors, 
collegiality, material incentives, the reputation of online teaching, complexity of developing and 
teaching courses online, technical support issues, time issues, compensation issues, and quality 
issues. 

• Besides completing the questionnaire, focus group participants were asked to think about all of 


Journal of Asynchronous Learning Networks, Volume 14: Issue 1 


25 



Using Focus Groups to Study ALN Faculty Motivation 


the potential sources of satisfaction and of dissatisfaction (including factors that may not have 
been included in the questionnaire) before arrival at the sessions, and to write down their “top 
three” in each category and bring this to the meeting. This two-step preparation process gave the 
focus group participants a common grounding in the range of factors that might be considered 
and also assured that they would have their own independent rankings of factors before the focus 
group discussion began. 

• A questioning route/set of steps was developed for the Focus Group sessions, which consisted of 
several parts: 

o Following a light lunch or supper and completion of consent forms, self introductions 
included experience teaching online and software platforms used. 

o Each faculty member was asked to describe his or her most important motivator that had 
not already been mentioned, which was then posted. This “nomination” proceeded in a 
round robin fashion until there were no more “top motivators” that had not already been 
suggested. Similar concepts were combined, resulting in a composite list of motivators. 
Discussion of each of these in some detail followed, with each faculty member invited to 
share experiences or reactions related to each of the constructs in turn. Then rank 
ordering of this list by the participants was accomplished by each participant giving five 
points to their first choice, four to their second, etc., with a maximum of five of the items 
on the lists to be given points by each individual. The points were then totaled and 
reported to produce the rank ordering. The generated lists and the final voting were 
recorded on large sheets of self-sticking paper placed along the wall in the front of the 
room and re-arranged as topics were combined or split, for all to see during the 
discussion and voting, and as a record of the results. 

o After a break, the same process was followed for sources of dissatisfaction and 
demotivators. 

o Taking the top reasons for lack of satisfaction, the focus group discussion developed an 
understanding of stakeholders related to these problems, and also actions that could be 
taken by specific stakeholders to decrease or solve the sources of dissatisfaction with 
teaching via ALN. 

Two recorders were used, transcripts were made and then the results were coded and analyzed. Individual 
transcripts ranged up to 60 pages long. After the initial four groups were completed at TechU, we used the 
same script and procedures for one session at the community college to test their replicability. 


IV. RESULTS: TECHU 

There was considerable agreement among the different groups about the top reasons for wanting to teach 
online, and also the top sources of dissatisfaction and frustration, although there were a few ideas that 
were unique to one particular group. We will first summarize the rank order of factors in the different 
groups, and then expand upon the factors that faculty feel most strongly about, by presenting 
representative quotes from the discussions. 


A. Motivators 

Table 1 shows the top ranked motivators using the terms developed by each group themselves. 
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Table 1. Motivators by group: TechU 

Group 1 

1 Flexible schedule (22) A 

2 Personal interaction (20) B 

3 Learning community (10) B 

4 Pedagogical challenge (8) C 

5 Reach more students (7) D 

6 Challenge of technology (4) C 

7 More effectiveness than face-to-face (2) 

Group 2 

1 Time/location flexibility (23) A 

2 Diverse students (22) D 

3 Faculty creativity (1 8) C 

4 Better interaction/quality (17) B 

5 Easier record keeping/course management (10) E 

Group 3 

1 Self-scheduling: anytime/anywhere (23) A 

2 Learn new technology (22) C 

3 Medium (being online) (20) B 

4 Better control (19) E 

5 Reaching non-traditional students (10) D 

6 Mentoring others (5) 

Group 4 

1 Flexibility of schedule (anytime/anywhere) (14) A 

2 Opportunity to work intensively with students (14) B 

3 Course management (11) E 

4 Meeting students’ needs/desires (10) D 

5 Professional development (6) C 

6 Diverse community (4) D 


The same procedures were repeated for the demotivators, and Table 4 presents a combined list of 
de motivators. We noted that several of the different terms are essentially synonyms for the same idea. 
Thus, all motivators of each group were pooled together, and similar ideas were combined by adopting a 
common terminology to generate a consolidated list of motivators. Letters in the lists in Tables 1 (and 3) 
show the categories into which differently worded factors that refer essentially to the same idea were 
combined. Table 2 shows the combined motivators. 


Table 2. Combined motivators: TechU 

Leading Motivators 

A Flexible schedules: anytime & anywhere (82) 

B Better and more personal interaction- medium characteristics 
improve pedagogy (81) 

C Challenge/creativity/professional development (58) 

D Reach more diverse students (53) 

E Better course management (40) 


As can be seen, when the results of the four groups are combined, the top motivator is flexibility of 
schedules due to fact that teaching can be done “any time, any place” where an internet connection can be 
obtained. This is followed by aspects having to do with the pedagogical advantages of the medium (e.g., 
more personal interaction, being able to build a learning community); the challenge and stimulation of 
learning new technology and creatively developing new pedagogical techniques; reaching more and more 
diverse students; and improved course management capabilities (largely due to software tools). 

Flexible schedules enabled by any time, anywhere teaching/learning topped the list of motivators. One 
female professor with extensive administrative as well as teaching responsibilities says, “It enables me to 
teach and I think that really goes under self scheduling because my calendar is so full and needs to be so 
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flexible that if I were to teach a face to course or more then one face to course, it would be impossible for 
me to schedule other things that need to be scheduled.” Another faculty member says, “For example, one 
of the courses I teach is only going once a year and if we offered it face-to-face, our students [could have 
conflicts] but by offering it online it satisfies all possibilities.” 


Ability to accommodate family responsibilities also was frequently connected to the advantages of 
teaching online. For instance, a mother of three young children mentioned, “the ability to move around if 
you need to, and the other thing is family balance, which is part of the moving. If you’re in another 
location, you’re still accessible (to your students).” An older faculty member with elder care 
responsibilities stated, “It came in very handy for me during my mother’s illness a couple years ago, 
because I had to be in Florida for a couple weeks.” Still another theme related to time and place flexibility 
is the ability to take advantage of professional opportunities such as attending conferences or spending 
part or all of a semester abroad. For example, a faculty member mentioned, “Flexibility of location and 
time. I spent one semester in France; I was teaching here distance learning, so that it was real distance 
learning!” 


Essentially tied as a leading motivator is the perception that pedagogy is improved by unique 
characteristics of online teaching using asynchronous text based discussion. There are several dimensions 
to this. Self pacing for the students was mentioned frequently. But so was the ability to interact more, and 
more personally, with students. “You begin to learn about the work habits of your students very quickly 
and I think you get to know them, because you’re dealing with them in a verbal way as opposed to a 
visual way... You don’t have these interactions in the classrooms, where mostly I’m doing the talking in 
front of the classroom and (only) some students will raise their hands, but I won’t get to know them 
better.” “You can really get to each student and bring each student along much more.” Another 
explanation ties together the nature of text based asynchronous communication with greater participation 
and better faculty knowledge about the students as follows: “In the online classes, I get to know my 
students better because I spend so much more time with them because when they write, they don’t write 
the way we speak in a class. We speak one sentence, two sentences at the most; but in an online course 
the students will write for four or five paragraphs, and so you get much, much more input from every 
student, and you get to know each student much better.” “It’s not just deeper, they’re more creative,” 
stated a participant in another group. 


Another aspect is the advantage of written text based communication for students for whom English is not 
the native language: “In the classroom, if a student has a heavy accent, or somebody is not there, or they 
mumble, or someone is paying attention to something else at the moment, what they say is lost; whereas 
online, there is a transcript of everything that goes on. So, that’s what I meant by (stating that) they learn 
more from each other.” 


Mentioned frequently as an advantage of the medium is its support for the emergence of a learning 
community among the students. “Students in e-learning have told me that they formed better relationships 
with other students than they would if they were in a face-to-face environment. That's kind of a motivator 
for me because I feel I get closer to students.” 


The challenges and satisfaction of learning new technologies and creatively applying them to teaching 
were also frequently mentioned. In particular, it was pointed out that use of technology in online teaching 
can improve the creativity of instructors. One faculty member says, “One of the things that I like about 
teaching online is it encourages the instructor to use creativity to create interesting things online which we 
don’t always do in the classroom. It’s enhancing creativity on the part of the instructor.” Another faculty 
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member explained, “I have to think a lot about how to motivate students to catch up with readings and 
assignments. It was really challenging for me and I really enjoyed it and I find many different ways to 
motivate them. That was the reason that I really like online teaching. I had to think. It was a big challenge 
for me to motivate them. It was kind of an experiment for me.” Many faculty members also echoed the 
sentiments of an instructor who described “the challenge of the technology... I just happened to enjoy 
using new technology that I haven’t used before and most of the time they worked well, occasionally they 
were frustrating, and exploring how I can use the new technology such as using WebCT. What new ways 
can I use it that I haven’t used it before? Personally, it is interesting and in the classroom, the technology 
is almost always the same.” 


That online courses can reach more, and more diverse, students is the fourth biggest motivator. 
Participants say that increased diversity of students can add more value to online learning. For example, a 
faculty member says, “In my class I know there are students who are taking my class while they are 
working in England or in California or in Oregon. Now these students came from Microsoft. They really 
add a lot of richness to the discussion. That's a really good quality.” Geographic and cultural diversity was 
also mentioned: “I’ve had students in Japan, Singapore, and India...” The expansion of opportunity to 
students who could not otherwise take university courses came up in every group. For example, one 
faculty member stated, “This way I can reach the students who might not have the opportunity to attend 
classes but they are very enthusiastic and they really want to learn.” As an example, she described “The 
ladies in my class that were in their 40s, and one of them was pregnant and she was telling me that she 
had three other kids. That was the only way that she could attend the classes.” 


It was also pointed out that online courses not only meet students’ needs for time and place flexibility, but 
also their desires, in terms of preferred mode of delivery, in a conversation that shows the synergistic 
thinking that often occurred. In one group, a faculty member observed, “There are a lot of students here 
who really enjoy this [online courses] and they seek us out semester after semester.” Another added, 
“Yeah, there is an interesting controversy related to that; in the administration here some don’t like the 
idea that students living in our dorms take an online course. They think it shouldn’t be allowed.” A third 
responded, “That’s wildly inappropriate. They enjoy doing this.” 


Easier course management is another big motivator. Participants say that the virtual classroom 
environment can allow more effective and efficient management of course materials and student 
participation. One female faculty member described the advantages of course management systems for, 
“Easier record-keeping for the class. Tracking students’ participations and having all their assignments in 
one place, it’s easier for them too because they then can see their grades when they’re posted and they can 
keep track of the teacher’s comments.” Another aspect is easier and more efficient distribution of course 
materials; students cannot lose or misplace the materials, since they can always find them online. Still 
another aspect is the ease of integrating rich, current material from websites: “I can round up the best 
websites on a topic that happens to come up... and all the student has to do is one click and the student is 
there.” 


B. Demotivators 

Table 3 shows the results for each individual focus group, whereas Table 4 combines similar terms and 
shows the overall rank order that results from combining the ranking results. 


Table 3. Demotivators by group: TechU 

Group 1 

1 More work overall (25) A 
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2 Lack of visual/direct connection with students (14) B 

3 Expectations of higher availability and attention from students (7) 
A 

4 Exam process (5) B 

4 Course development (5) A 

6 Loneliness from working alone at home (4) 

6 Evaluation process (4) E 

8 Too many unqualified students are allowed to take DL courses 
(3) C 

9 Some class sizes are too large (2) C 

Group 2 

1 Lack of face-to-face/synchronous contact (19) B 

2 More work/no more pay (1 8) A 

3 Characteristics of DL students (15) D 

4 Dropouts/losing students (13) 

4 Lower student evaluation (13) E 

6 Issues of control (6) B 

7 Lack of technology at (university) (5) C 

8 DL exam (1) 

Group 3 

1 Medium problems (28) B 

2 Workload (20) A 

3 Lack of recognition from peers/administration/general 
staff/students (14) F 

4 Course evaluation (10) E 

5 Training and support at (university) (11) C 

6 Lack of compensation/control (7) A 

Group 4 

1 More work/time (1 7) A 

1 Lack of policy in (university) (17)C 

3 Lean text-only medium (14) B 

3 Does not fit all students (14) D 

5 (University) emphasizes profits over quality (9) C 

6 Lack of peer/administration recognition (4) F 


Table 4. Combined Demotivators 

Leading Demotivators 

A More work/inadequate compensation (99) 

B Medium problems (86) 

C Lack of support/appropriate policies for online teaching (48) 
D Does not fit all students (29) 

E Ineffective/poor evaluation (27) 

F Lack of recognition (18) 


In terms of demotivators, two factors stand out: more work and problems with the medium. Participants 
perceive that online teaching requires more time and energy than face-to-face teaching. An experienced 
part time faculty member who has taught the same course both online and face-to-face for several years 
summed up her feelings by saying, “I think it’s more work, stressful and more time consuming too.” 
Another led off the conversation on demotivators by saying, “The thing that is most difficult to me is that 
it’s double to triple the time, while teaching the course, plus also it’s also an unpaid two to three months 
to develop it.” In another group, a faculty member said, “I have a face-to-face class that’s three hours a 
night and I feel I'm short-changing them very badly because maybe I read their papers for eight hours, and 
I'm there for three hours so that’s eleven hours; but with the online course, I'm off and on and reading 
their papers and responding to them for maybe twenty hours for one course, and that doesn’t count 
developing the course either.” 


30 


Journal of Asynchronous Learning Networks, Volume 14: Issue 1 



Using Focus Groups to Study ALN Faculty Motivation 


A faculty member says, “It’s a lot tougher to teach a distance course; it’s a lot more work for the 
instructor. It forces us to communicate better. And it also forces us to create better learning materials. 
Because just attaching the textbook with some videos, or whatever, is not really the norm anymore.” 
Another faculty member describes the constant demand to be online and responsive, a theme repeated by 
many others: “I had to log in a couple of times a day, or sometimes more than that. I had to respond to 
them immediately, otherwise they wouldn’t have done their assignments, they would have said, ‘Oh, you 
didn’t answer my emails.” 


Finally, there were complaints about lack of policy to provide course releases or extra pay for preparing 
and recording the digital materials for online courses at TechU. For example, “I’ve been doing an extra 
three hours of work a week all last semester taping a course, for which I don’t get paid one cent.” 


The amount of time it takes to respond to students in writing rather than orally is one of the frequently 
mentioned “medium problems,” that is related to “more work. A faculty member describes her time 
consuming process of trying to make sure that every posting is clear and has the right “tone.” “I do my 
bulletin board postings in Word, and that checks for the spelling and stuff, and then I usually re-read it 
two or three times before I post it. It's all they know of you on the bulletin board postings, and it's also all 
they know of you with the assignments and things. If you say something in one way in one place, and 
then a slightly different way in another place they get confused.” 


The administrative difficulty of dealing with a barrage of assignments handed in online is also described 
frequently in terms of adding to the workload. “Opening up all those files and trying to organize them. I 
have to open it up, read through and grade it, make sure that the grade gets recorded in my spreadsheet, 
move that email into a separate folder so that I have a record of it, and reply to the student.” 


Regarding problems with the medium, participants pointed out that they are highly related to the fact that 
the major communications method in online teaching is based on text. One female participant says, “I'm 
going to bring one up that's different but what you're really talking about again, it has to do with the 
medium, is that I think it really is because it's a text based, lean medium and you lose a lot of emotional 
cues.” 


Interestingly enough, it was also pointed out that more work in online teaching is mostly caused by media 
problems, implying that solutions to media problems may reduce workload of instructors teaching online. 
For example, one participant says, “I think workload for me is related to media problems. Inextricably, of 
all the things that I said and other people said about the medium... it's text based, if we’re going to 
another modality and that's the fix, that's not solely text based, I think you’ll change [decrease] the 
workload a lot.” 


Lack of appropriate institutional support and policies for online teaching ranks third. Many participants 
said that they feel the lack of administrative and technical support discourages online teaching. For 
example, one participant states, “Well, it's hard to argue that if you have to do more with fewer resources. 
It is a problem that's daunting because we know in fact the kinds of technology that would make this a 
much richer kind of thing, all of which cost money which we don't have.” 


Another important demotivators is that the unique characteristics of online learning may not fit some 
students. “The older ones are uneasy with discussion. They come in (to the class) with, you know, young 
people who grew up with computers, so it's like swimming to them, but older people... sometimes their 
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skills are dated.. But if they’ve been working in a police department, or have been working as a reporter, 
for instance, they sometimes have skills. So there's people with no skills, and people with super skills at 
the same time” (and teaching to both in the same class can be difficult). 


At the institution studied, in recent years, the average student teaching ratings for online courses have 
tended to be lower than the average for face-to-face courses. Lower evaluations harm the faculty in terms 
of promotion, tenure, merit raises, and recognition. There was considerable speculation about the causes 
of this phenomenon in the groups. One reason suggested was that face-to-face evaluations are given in 
class and thus have a very high response rate. For online course evaluations, students have to choose to go 
to the web site and complete the questionnaire on their “own” time rather than during class time. 
Response rates are much lower. Several faculty suggested that the most disgruntled students are the most 
likely to take the time to complete these evaluations, just as it seems that a disproportionate number of 
unhappy students use optional teacher rating sites such as “RateMyProfessors.com.” In another group, 
one professor expanded on the idea of selection bias: “I also think that there is some selection bias not 
only in responses, but in [who is] taking the course, they're probably too busy, they have to do something 
else and their commitment to the expectations of the course are that this is going to be easier, then they 
find out it’s not.” 


Others speculated that both some faculty and some students have incorrect assumptions about what it 
takes in terms of effort to successfully teach and learn online. For example, a woman who had both taught 
online and been a student in graduate courses said, “you know a lot of instructors, they teach DL because 
they think it’s easier to teach, and at the same time a lot of students take it because they think it’s easier to 
study that way, both of them are wrong.” A senior faculty member chimed in, “And I think that accounts 
for some of the lower evaluations of DL faculty.” A third said she had talked to some of the students who 
had not done well and who seemed dissatisfied, and they said, “Oh, you were giving us a lot of work, we 
didn’t expect to do that much in a DL course, its just so much work.” 


Several faculty spoke very passionately about the fact that they felt that they worked harder (and did a 
better job) online, but were actually devalued or stigmatized by the administration and their peers for 
teaching online. For example, one instructor lamented, “I have a huge problem about lack of recognition 
from the community.... Lack of recognition from my peers— all of my buddies in my school of 
management, they all laugh at me, because I don't go to the class. As if I'm not doing anything. So I 
wonder whether the administrators also think that way, that we are getting away with nothing... distance 
learning takes more time than face-to-face. But I don't worry about it, that's ok with me. The point is that 
people all laugh at me, they think that you are very lazy.” Another faculty member in the group jumped in 
saying, “Not only peers and administration, I think there's a general stigma like “mail order degree” kind 
of thing.” 


V. A SINGLE REPLICATION AT ANOTHER UNIVERSITY 

Following the procedural guidelines previously described, a replication focus group was conducted at a 
single college in a different state situated in a large state system of higher education in the Northeastern 
United States. The replication group consisted of one meeting of eight participants who represented full- 
time and adjunct faculty members from a two-year community college that offers eighteen online degree 
programs serving approximately 2,800 students. Participants ranged from absolute novices to highly 
experienced. Two participants had never taught online but were interested in doing so. One participant 
had just completed teaching his first online course. Four participants had taught online more than once 
and one had taught a full five course load online for fifteen semesters in a row. 
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Table 5 provides a list of the overall rank order that resulted from combining all participants’ top five 
motivators. 


Table 5. Combined Motivators for Replication Group 

Leading Motivators 

A Time flexibility (i.e., convenience anytime/anywhere, flexibility of schedule) (27) 

„ Personal satisfaction of serving students without access to traditional higher education experience 

B (14) 

C Learning new technology (12) 

D Pedagogy - more student participation, more engagement, more learning (1 1 ) 

E Additional pay for extra services (i.e., salary increased, better end salary) (1 0) 


The results for the replication focus group were very similar to those of the primary focus groups. Both 
identified motivators of time and schedule flexibility, personal satisfaction of serving more students, 
learning new technology, and pedagogy enhancements created by the online modality. Time flexibility, 
i.e., flexibility and convenience in their schedules, led the list of motivators for both the primary and 
replication group. In the replication group, two participants, one female and one male, commented that 
full-time administrative responsibilities paired with family obligations limited their opportunities to teach 
on campus and online courses provide an opportunity to continue to teach. The male instructor noted that 
“just the opportunity to teach, as I work fulltime... I would not be able to teach during the day, and I have 
a family... instead of teaching at night, it [online teaching] just gives me a chance to do something 
different and new.” 


When comparing the replication groups’ top five motivators to the initial focus groups’ list, one 
noticeable difference was that the replication group indicated the motivation of opportunities for 
additional pay for online teaching as one of their top motivations. One faculty member stated that “the 
chance to do extra services; which for me means extra money” was a main factor for teaching online. 
These contextual differences appear to be related to institutional variables and will be investigated further 
in follow-up reports of survey data collected in this study. 


The top demotivators were collected from the focus group following the same procedure previously 
described. Flere the respondents indicated that their top de-motivator was the feeling that they were 
“never off,” i.e., they needed to respond to students’ needs and questions immediately in order to meet 
students’ expectations and that this resulted in additional work. Table 6 displays the overall rank order 
that resulted from combining all participants’ ranking results. 


Table 6. Combined Demotivators for Replication Group 
Leading Demotivators 

. Never “off” (i.e., need to be responsive 24/7 to meet students’ expectations, therefore more work) 

(23) 

B Lack of support for Distance Learning from administration at all levels for purchasing technology and 

for policy implementation (18) 

C Students with poor academic preparation, behaviors, and attitudes (15) 

D Lack or absence of face-to-face contact with students (1 0) 

E Uncertainty of who the students are (i.e., is the registered student actually doing the course work) (7) 
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Once again the clearest result is the similarity between the primary and replication focus groups. Three of 
the top five demotivators were common to both groups including perceptions of additional work, lack of 
support and student issues (poor preparation, attitudes or poor fit). The demotivators also differed 
somewhat, the replication group identified lack of face-to-face contact as a serious issue. They also had 
uncertainty about who their online students were and whether there might be issues with registered 
students getting others to do their coursework. They were less concerned about recognition. These 
dissimilarities between the primary and replication groups also appear related to differing institutional 
cultures. Again these types of differences will be further analyzed in results of the survey research. 


VI. DISCUSSION AND CONCLUSION 

The combination of nominal group technique and focus group discussion that we used has the advantage 
of generating evidence about why and how various motivators and demotivators are important to faculty. 
Just as online discussions can be synergistic, the group discussion stimulated faculty to think of examples 
and extensions of ideas that they otherwise would not have thought of. It was evident during the 
discussions that the discussion process itself changed the thinking of some participants about what were 
the most important sources of satisfaction and dissatisfaction. Though not reported here, the discussion of 
steps that could be taken to alleviate some of the demotivators also benefited from the group interaction. 
Thus, the method is recommended to other institutions that wish to obtain a better understanding of their 
online faculty and of steps that can be taken to improve their motivation for teaching online. 


Though the results of separate groups’ rankings were combined in this paper to produce an overall 
ranking, the numbers produced should be interpreted in a qualitative rather than a quantitative way, 
meaning that a different set of groups would undoubtedly produce different “numbers.” However, the 
striking similarities in top motivators and demotivators among all four groups, as well as the replication 
group at a different institution, indicate that the overall results appear to have a reasonably strong 
measure of validity. 


Among the most actionable results that we obtained is the following puzzle: faculty at TechU say that 
they work harder online, and that they think that most of the students they teach learn more via this 
medium, and that they are able to reach more students and a greater diversity of students. However, many 
feel that their efforts are not only not rewarded, but actually devalued by the institution and by many of 
their colleagues. They lament the absence of policies that adequately train, guide, and reward online 
faculty. Certainly, the institution at which this study took place could take steps to change this situation. 
Official praise and encouragement from high administrative levels, which costs nothing, would go a long 
way towards eliminating this source of dissatisfaction. 


The most interesting methodological results of this study will come from comparing the statistics 
gathered from the online survey taken by a much larger number of faculty, with the outcomes of the focus 
groups. We expect that they will be complementary. Secondly, we expect that the results for the two 
initial universities studied will be different in substantial ways and similar in others; however, as we do 
not have the two sets of outcomes available for this paper, this remains a speculation. If they are different, 
this will add support to theories such as those by Rogers [11] about the importance of contextual factors 
in modifying the impacts and effects of a technology such as ALN. In terms of the practical implications 
of the results, we need to determine generalizability beyond these first two institutions, to a much broader 
set of institutions, ideally outside of the U.S. as well as inside. 


By understanding faculty motivations related to teaching online, we hope to generate recommendations 
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that will help to engage and retain a larger number of online instructors. Ultimately the objective of 
increasing access to quality higher education for a far larger number of students, many of whom cannot 
easily attend traditional courses, will thereby be advanced. 


VII. ACKNOWLEDGMENTS 

This is a revised and expanded version of a paper presented at the 2007 Flawaii International Conference 
on System Sciences. This research is partially supported by the Alfred P. Sloan Foundation. Students 
Chike Uzoka and Adonis Peralta assisted with transcribing the focus group discussions. We are grateful to 
the many faculty members who made time in their busy schedules to participate in this study. 


VIII. ABOUT THE AUTHORS 

Starr Roxanne Hiltz is a Distinguished Professor in the Department of Information Systems 
College of Computing Sciences at the New Jersey Institute of Technology. She conducts research on 
applications and social impacts of computer technology, focusing on computer-mediated communication. 
She conducted one of the earliest and pioneering longitudinal studies of “Online Communities” (1984). 
Subsequently she conceived of the possibility of an online “virtual classroom” environment; designed, 
implemented, and studied the first version of such a system in 1986. She was project director of the 
“WebCenter for Learning Networks Effectiveness Research”, an online knowledge repository and 
research community to improve the quality, quantity, and dissemination of research on online courses. In 
November 2004, she won the Sloan Consortium award for “Most Outstanding Achievement in Online 
Teaching and Learning by an Individual.” 


Peter Shea is an assistant professor in the department of Educational Theory and Practice with a joint 
appointment in the College of Computing and Information at the University at Albany, State University 
of New York. Previously he served as the Director of the SUNY Learning Network, the multiple-award 
winning, online education system for the State University of New York. Peter has also served as manager 
of the SUNY Teaching, Learning, and Technology Program and as Project Director in the Multimedia 
Educational Resource for Learning and Online Teaching (MERLOT), as well as a SUNY representative 
to the EDUCAUSE National Learning Infrastructure Initiative (NLII — now ELI). 


Peter’s current research focuses on the student and faculty experience in technology-mediated teaching 
and learning, most recently on the topics of “teaching presence” and community in asynchronous learning 
networks. He is the author of many articles and several book chapters on the topic of online learning, co- 
author of the book, The Successful Distance Learning Student (Thomson- Wads worth) and a contributor to 
the recent book, Learning Together Online: Research on Asynchronous Learning Networks (Erlbaum). 

He is a co-recipient of several awards including the EDUCAUSE Award for Systemic Progress in 
Teaching and Learning for the State University of New York, and two Sloan Consortium Awards for 
Excellence in Faculty Development and Asynchronous Learning Networks Programs. He is a member of 
the American Educational Research Association and the editorial board for the Journal of Asynchronous 
Learning Networks. His research has appeared in the Journal of Educational Computing Research, The 
International Review of Research in Open and Distance Learning, and the Journal of Asynchronous 
Learning Networks among others. 


Eunhee Kim is a faculty member in Management Information Systems at Northern State University. 


Journal of Asynchronous Learning Networks, Volume 14: Issue 1 


35 



An Empirical Verification of the Community of Inquiry Framework 


IX. REFERENCES 

1. Allen, E. I. and J. Seaman. Entering the Mainstream: The Quality and Extent of Online Education 
in the United States, 2003 and 2004. Needham, MA: Sloan-C, 2004. 

2. Hiltz, S. R. and R. Goldman (Eds.) Learning Together Online: Research on Asynchronous Learning 
Networks. Mahwah NJ: Erlbaunr, 2005. 

3. Anderson, S. E. Understanding teacher change: Revisiting the concerns-based adoption model. 
Curriculum Inquiry 27: 331—367, 1997. 

4. Cheung, D., J. Nattie and N. Davis. Re-examining the stages of concern questionnaire: A test of 
alternative models. The Journal of Educational Research 94: 226-236, 2001. 

5. Davis, E., R. Bagozzi and P. Warshaw. User acceptance of computer technology: A comparison of 
two theoretical models. Management Science 35(8): 982-1003, 1989. 

6. Fuller, F. F. Concerns of teachers: A developmental conceptualization. American Educational 
Research Journal 6(2): 207—226, 1969. 

7. Hall, G. E., R. C. Wallace and W. A. Dossett. A developmental conceptualization of the adoption 
process within educational institutions. Austin, Research and Development Center for Teacher 
Education: University of Texas at Austin, 1973. 

8. Hall, G. E. and S. M. Hord. Change in Schools: Facilitating the Process. Albany, NY: State 
University of New York Press, 1987. 

9. Hall, G. E. and S. M. Hord. Implementing Change: Patterns, Principles, and Potholes. Needham 
Heights, MA: Allyn & Bacon, 2001. 

10. Rogers, E. M. Diffusions of Innovations . New York: Free Press, First Edition, 1963. 

11. Rogers, E. M. Diffusions of Innovations . New York: Free Press, Fifth Edition, 2003. 

12. Dzuiban, C., P. Shea and J. B. Arbaugh. Faculty Roles and Satisfaction in Asynchronous Learning 
Networks. In: S. R. Hiltz and R. Goldman (Eds.), Learning Together Online: Research on 
Asynchronous Learning Networks , 169-190. Mahwah NJ: Erlbaum, 2005. 

13. Muilenburg, L. Y. and Z. L. Berge. Barriers to distance education: A factor-analytic study. The 
American Journal of Distance Education 15(2): 7—22, 2001. 

14. Alavi, M. and R. B. Gallupe. Using information technology in learning: Case studies in business and 
management education programs. Academy of Management Learning and Education 2(2): 139-153, 
2003. 

15. Garrison, D. R., T. Anderson and W. Archer. Critical thinking, cognitive presence and computer 
conferencing in distance education. The American Journal of Distance Education 15(1): 7-21, 2001. 

16. Coppola, N. W., S. R. Hiltz and N. G. Rotter. Becoming a virtual professor: Pedagogical roles and 
asynchronous learning networks. Journal of Management Information Systems 18(4): 169-189, 2002. 

17. Fredericksen, E., A. Pickett, P. Shea, W. Pelz and K. Swan. Factors influencing faculty 
satisfaction with asynchronous teaching and learning in the SUNY Learning Network. Journal of 
Asynchronous Learning Networks 4(3): 245—278, 2000. 

18. Almeda, M. B. and K. Rose. Instructor Satisfaction in University of California Extension's On-line 
Writing Curriculum. Journal of Asynchronous Learning Networks 4(3): 180-195, 2000. 

19. Shea, P., W. Pelz, E. Fredericksen and A. Pickett. Online teaching as a catalyst for classroom- 
based instructional transformation. Elements of Quality Online Education. Needham, MA: Sloan-C, 
2002 . 

20. Hartman, J, C. Dziuban and P. Moskal. Faculty Satisfaction in ALNs: A Dependent or 
Independent Variable? Journal of Asynchronous Learning Networks 4(3): 155-179, 2000. 

21. Shea, P., A. Pickett and C. Li. Increasing access to higher education: A study of the diffusion of 
online teaching among 913 college faculty. International Review of Research in Open and Distance 
Learning 6(2): 2005. 

22. Nielsen, J. Use and misuse of focus groups, www.useit.coni/papers/focusgroups.htnil . 

23. Krueger, R. Focus Groups: A Practical Guide for Applied Research, Second Edition. Thousand 
Oaks CA: Sage, 1994. 


36 


Journal of Asynchronous Learning Networks, Volume 14: Issue 1 


Using Focus Groups to Study ALN Faculty Motivation 


24. Hesse-Biber, S. and P. Leavy. The Practice of Qualitative Research. Thousand Oaks CA: Sage, 
2006. 


X. APPENDIX: FOCUS GROUP PROCEDURES 
AND QUESTIONING ROUTE 

1) Ahead of time: confirm attendees and ask for their cell phone numbers. Send them email instructions 
one week ahead which confirms date and time and place and refreshments, and also states the 
following: 

The purpose of our focus group study is to gain an understanding of the main sources of 
satisfaction and dissatisfaction (or “motivators” and “demotivators”) for teaching courses online, 
for TECHU faculty. We also want to develop ideas about possible actions that could be taken to 
improve faculty satisfaction. 


In preparation for this discussion, sometime during the three days before the meeting, please do the 
following: 

a. To get an overview of a wide spectrum of possible motivators and demotivators, take the 
Faculty Survey on this topic (designed by Peter Shea of SUNY Albany and Moderator Hiltz 
of TECHU). 

b. Write down approximately THREE (2-4) things that are your personal “top motivators” or 
sources of satisfaction. Be prepared to explain why these are important to you. 

c. Then write down the top approximately THREE “demotivators” or sources of dissatisfaction 
for you in regard to teaching online courses at TECHU. Also be prepared to explain why you 
think these are important. Finally, think about what could be done by whom, in order to 
improve the situation in regard to these “demotivators.” 

d. Please bring these lists and maybe some notes with you, to share during our focus group 
discussion. 


2) Procedures and Questioning Route at the Meeting 

NOTE: Roles include a MODERATOR and an ASSISTANT MODERATOR. 


SETUP: Ideally a U-shaped table; moderator and assistant moderator are at front of the “U” and 
have a wall to post sticky- chart pages. At least two audio recorders or one recorder and a 
videotape recorder are used. 


a. As people arrive: ASSISTANT - greets them by name, hands them a gift card and has them 
sign that they received it, helps them hang up coats, takes them to the table to put down their 
things and invite them to help themselves to the snacks. Moderator will stay at table and 
Assistant stays near door. Introductions and small talk while they eat for about 15 minutes. 
Anyone who is late is called on a cell phone if available. 

b. When everybody has had at least 10 minutes to chat and snack, Moderator starts the self- 
introductions, which should be recorded. Participants are asked to give their name, 
department, and the courses they have taught online or hybrid and the software systems or 
technologies they have used. 

c. Assistant draws seating chart. (Note; throughout meeting, assistant listens for tapes running 
out and replaces them as necessary). 
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d. Moderator conducts consent form procedure, followed by emphasis on confidentiality: 
Participants need to be encouraged to keep confidential what they hear during the meeting. 

e. Then the focus group begins, using a round robin procedure. The first task is creating a 
composite list of top motivators; as each new idea is contributed, and a brief explanation 
given, Assistant writes in it compact form on a flip chart page, leaving space for a few key 
words to be added later. Put down only about 1-2 ideas a page to leave room, and start 
pasting the pages up on the white board or a wall. We go around group until there are no 
more new ideas. 

f. The Moderator leads the group back to examine and expand upon each of the set of ideas, and 
the Assistant briefly notes these expansions and examples under each heading. (Try to make 
sure everybody is participating, start at different places around the table for different ideas). 
Some very similar ideas may then be combined. 

g. Participants write down their rank order of the top FIVE motivators for them. Each 
participant then calls out their rank number 1 (given 5 points), two (4 points; 3 (3 points); 4 (2 
points) and 5(1 points) - these points are recorded on the chart and then totaled. 

h. Examination and discussion of these; if it is not clear that there are two to three “top best 
things,” conduct a re -ranking from just among the top ten or so, scoring to give us the “top 
three” for the group. 

i. The above takes about an hour and fifteen minutes. Participants are invited to take a five 
minute stretch, bathroom break and refill refreshments. Assistant collects flip chart pages and 
rolls them up for later use. 

j. The same process is repeated for sources of dissatisfaction and demotivators. 

k. Taking the top reasons for lack of satisfaction, and through the focus group discussion, 
develop an understanding of stakeholders related to these problems, and of actions that could 
be taken by specific stakeholders to decrease or solve the sources of dissatisfaction with 
teaching via ALN. 

l. If time allows, go to the top three motivators and think about what could be done to capitalize 
on them. 

m. Thank participants. If time, get feedback on process. 

n. Immediately after the meeting, the moderator (and assistant moderator) should create a 
meeting summary- perhaps a recorded discussion rather than a written report- in which they 
give their perceptions of the critical points and notable quotes that occurred during the 
session. 

o. By the next day: assistant uses flip charts to create a summary of the motivators and 
demotivators and the “votes.” 

p. A transcript is made (by the assistant or other helpers) and then the results coded and later 
analyzed using a qualitative text analysis tool such as N-Vivo. 
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